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(54) Image transmission system and method 



(57) There is disclosed an image transmission sys- 
tem for transmitting MPEG data through a transmission 
path, capable of setting frames for the MPEG data to be 



transmitted, according to the traffic in the transmission 
path, and effecting an accounting process with a charge 
system corresponding to thus set frames. 
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Description 

The present Invention relates to information provid- 
ing in a multimedia network tor transmitting various in- 
formation such as moving image data, still image data, 
voice data, computer data etc., and an image transmis- 
sion and method corresponding to such information pro- 
viding. 

In recent years, so-called information service indus- 
try is showing remarkable progress as a result of instal- 
lation of the optical fiber network in the main communi- 
cation networks, spreading of the cable television sys- 
tems, commercial exploitation of the satellite communi- 
cation, popularization of local area networks. Such in- 
formation service industry is to provide various informa- 
tion through such various communication networks and 
to collect the charge according to the content and quan- 
tity of the provided information. In such information serv- 
ice industry, therefore, it is an important issue to effect 
appropriate charging, for the provided information. 

However, the charging system conventionally em- 
ployed in the information service industry has mostly 
been a monthly charging for charging a fixed charge re- 
gardless of the frequency of use, such as in the cable 
television systems or in the satellite broadcasting, or a 
charging method only counting the frequency or time of 
use regardless of the kind or quality of the provided in- 
formation, such as in the computer utilizing service. 

In consideration of the foregoing, the object of the 
present invention is to enable charging, in consideration 
of the kind of the information or service and the quality 
of the information. 

The above-mentioned object can be attained, ac- 
cording to one embodiment of the present invention, by 
an image transmission system for transmitting MPEG 
data through a transmission path, capable of setting a 
frame of the MPEG data to be transmitted, according to 
the traffic of the transmission path and effecting the 
charging according to a charge system corresponding 
to thus set frame. 

According to another embodiment of the present in- 
vention, there is provided an image transmission system 
for transmitting MPEG data between a transmission ter- 
minal and a receiving terminal through a transmission 
path, comprising a receiving terminal including frame 
setting means for setting a frame for the MPEG data to 
be transmitted, according to the traffic of the transmis- 
sion path, accounting process means for effecting an 
accounting process with a predetermined charging sys- 
tem, and a transmitting terminal including image charge 
information storing means for storing the charge infor- 
mation tor the images to be used in the above-men- 
tioned accounting process. 

Also according to still another embodiment of the 
present invention, there is provided an image transmis- 
sion system for transmitting MPEG data through a trans- 
mission path, comprising frame setting means for set- 
ting a frame for the MPEG data to be transmitted, ac- 



cording to the traffic of the transmission path, and ac- 
counting process means for effecting an accounting 
process with a charge system according to the frames 
~ of the transmitted MPEG data and the amount of infor- 
s mation. 

Also according to still another embodiment of the 
present invention, there is provided an image transmis- 
sion system for transmitting MPEG data through a trans- 
mission path, comprising traffic check means for check- 
w ing the traffic of the transmission path, frame setting 
means for setting a frame for the MPEG data to be trans- 
mitted, according to the traffic of the transmission path, 
accounting process means for effecting an accounting 
process with a predetermined charge system, informa- 
J5 tion amount measuring means for measuring the 
amount of information of the image transmitted through 
the transmission path, and image charge information 
storage means for storing the charge information for the 
image, to be used in the accounting process. 
20 Also according to still another embodiment of the 
present invention, there is provided an image transmis- 
sion system tor transmitting MPEG data through a trans- 
mission path, comprising traffic check means for check- 
ing the traffic of the transmission path, frame setting 
25 means for setting a frame for the MPEG data to be trans- 
mitted, according to the traffic of the transmission path, 
accounting process means for effecting an accounting 
process with a charge system according to the frames 
and the amount of information of the transmitted MPEG 
30 data, and image charge information storage means for 
storing the charge information of the image, to be used 
in the accounting process. 

According to still another embodiment of the 
present invention, there is further provided charge pay- 
35 ing means for paying the charge at a predetermined in- 
terval. 

According to still another embodiment of the 
present invention, the above-mentioned accounting 
process means is provided in the transmitting side. 

40 Also according to still another embodiment of the 
present invention, the above-mentioned accounting 
process means is provided in the receiving side. 

Also according to still another embodiment of the 
present invention, the above-mentioned accounting 

45 process means is provided both in the transmitting side 
and in the receiving side. 

Also according to still another embodiment of the 
present invention, there are provided image transmis- 
sion destination designating means for designating an 

50 arbitrary image receiving apparatus.for the destination 
of image transmission and requesting the image trans- 
mission for an image provider, image transmission 
means for transmitting the image to the image receiving 
apparatus designated by the image transmission desti- 

55 nation designating means, and accounting process 
means for effecting the charge accounting either to the 
designated destination of the image or to the user re- 
ceiving the image. 
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Also according to still another embodiment of the 
present invention, there is provided cypher means tor 
effecting at least encyphering or digital signature to the 
transmitted information. 

Owing to the technologies mentioned above, the 
embodiments of the present invention allow to set a 
frame for the MPEG data to be transmitted, according- 
to the traffic of the transmission path, and to apply a 
charge for the image according to the content of thus 
set frame. 

Also according to still another embodiment of the 
present invention, it is rendered possible to effect the 
accounting process with a charge system taking into 
consideration the amount of information of the image in 
addition to the content of the transmitted frame. 

Also according to still another embodiment of the 
present invention, it is rendered possible to effect pay- 
ment of the charge at a predetermined interval. 

Also according to still another embodiment of the 
present invention, it is rendered possible to protect the 
information from theft or illegal alteration and to effect 
fair accounting. 

Another image transmission apparatus of the 
present invention, for handling the MPEG data, is fea- 
tured by comprising accounting means for effecting an 
accounting process according to the kind of the trans- 
mitted frame among the MPEG data, and charge stor- 
age means for storing the charge for the image. 

Still another image transmission system of the 
present invention, for handling MPEG data, is featured 30 
by comprising accounting means for effecting an ac- 
counting process according to the kind of the transmit- 
ted frame. 

Still another image transmission system of the 
present invention, for handling MPEG data, is featured 35 
by comprising accounting means for effecting an ac- 
counting process according to the kind and the amount 
of information of the transmitted frame, among the 
MPEG data. 

According to still another feature, there is provided <o 
an image transmission system for handling MPEG data, 
comprising accounting means for effecting an account- 
ing process according to the kind of the transmitted 
frame among the MPEG data, information amount 
measuring means for measuring the amount of informa- 
tion of the transmitted frame, and charge storage means 
for storing the charge for the image. 

According to still another feature, there is provided 
an image transmission system for handling MPEG data, 
comprising accounting means for effecting an account- « 
ing process according to the kind and the amount of in- 
formation of the transmitted frame among the MPEG da- 
ta, and charge storage means for storing the charge for 
the image. 

According to still another feature, there is provided « 
an image transmission system for handling MPEG data, 
comprising accounting means for effecting an account- 
ing process according to the kind and the amount of in- 



formation of the transmitted frame among the MPEG da- 
ta, information amount measuring means for measuring 
the amount of information of the transmitted frame, and 
charge storage means for storing the charge for the im- 
age. 

According to still another embodiment of the 
present invention, there is provided an image transmis- 
sion system for handling MPEG data, comprising ac- 
counting means for transmitting all the frames of the 
MPEG data and effecting an accounting process ac- 
cording to the kind of the frame decoded among the 
MPEG data. 

Owing to the technologies mentioned above, the 
embodiments of the present invention allow to apply the 
charge for the image for each mode. 

According to still another embodiment of the 
present invention, since the accounting is made accord- 
ing to the mode and the amount of information of the 
image information, it is rendered possible to account the 
charge for the image for each mode and also in consid- 
eration of the amount of information. 

According to still another embodiment of the 
present invention, there is provided paying means for 
paying the charge at a predetermined interval, so that 
the charge accounting can be made at a predetermined 
period by calculating the accumulated charge. 

According to still another embodiment of the 
present invention, it is rendered possible to effect an ac- 
counting process according to the kind of the decoded 
frame among the transmitted MPEG data. 

Embodiments of the present invention will now be 
described with reference to the accompanying draw- 
ings, in which:- 

Fig. 1 is a schematic block diagram showing ac- 
counting process means of a first embodiment; 
Fig. 2 is a block diagram showing a specific exam- 
ple of the configuration of the accounting process 
means in the first embodiment; 
Fig. 3 is a view showing an example of the charge 
table to be used by the accounting process means 
of the first embodiment; 

Fig. 4 is a schematic block diagram of the account- 
ing process means in a second embodiment; 
Fig. 5 is a block diagram showing a specific exam- 
ple of the configuration of the accounting process 
means in the second embodiment; 
Fig. 6 is a view showing an example of the charge 
table to be used by the accounting process means 
of the second embodiment; 
Fig. 7 is a schematic block diagram showing ac- 
counting process means of a third embodiment; 
Fig. 8 is a block diagram showing a specific exam- 
ple of the configuration of the accounting process 
means in the third embodiment; 
Figs. 9A and 9B are views showing examples of the 
charge table to be used by the accounting process 
means of the third embodiment; 
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Fig. 10 is a block diagram showing the basic con- 
figuration of an image transmission system in a 
fourth embodiment; 

Fig. 11 is a view showing the function of the image 
transmission system in the fourth embodiment; 
Fig. 12 is a block diagram showing the basic con- 
figuration of an image transmission system in a fifth 
embodiment; 

Fig. 13 is a view showing the function of the image 
transmission system in the fifth embodiment; 
Fig. 14 is a block diagram showing the basic con- 
figuration of an image transmission system in a 
sixth embodiment; 

Fig. 15 is a view showing the function of the image 
transmission system in the sixth embodiment; 
Fig. 1 6 is a view showing a system in a seventh em- 
bodiment; 

Fig. 17 is a view showing the accounting process in 
the system of the seventh embodiment; 
Fig. 1 B is a view showing a system in an eighth em- 
bodiment; 

Fig. 1 9 is a view showing the accounting process in 
the system of the eighth embodiment; 
Fig. 20 is a view showing the frame configuration in 
the MPEG data; 

Fig. 21 is a view schematically showing the format 
of the MPEG encoded image data; and 
Fig. 22 is a view showing a key sequence in ency- 
phering MPEG data. 

Following embodiments are applied to a transmis- 
sion system for transmitting MPEG data through atrans- 
mission path, for enabling, in consideration of the fea- 
ture of the MPEG data, to set a frame for the MPEG data 
to be transmitted according to the traffic of the transmis- 
sion path and to a charge for the image according to the 
above-mentioned frame. 

Particularly in a first embodiment, there will be ex- 
plained accounting process means for effecting an ac- 
counting process with a charging system in which charg- 
es are determined respectively for a case of transmitting 
an I frame only, a case of transmitting an I frame and a 
P frame, and a case of transmitting an I frame, a P frame 
and a B frame. 

In a second embodiment, there will be explained the 
accounting process means with a charge system in con- 
sideration of the amount of information of the image, in 
addition to the case of transmitting an I frame only, an I 
frame and a P frame, and an I frame, a P frame and a 
B frame. 

In a third embodiment, there will be explained the 
accounting process means for accounting the charge at 
a predetermined interval in the first and second embod- 
iments. 

In a fourth embodiment, there will be explained a 
configuration in which the accounting process means in 
the first to third embodiments is provided in the image 
providing side. 



In a fifth embodiment, there will be explained a con- 
figuration in which the accounting process means in the 
first to third embodiments is provided in the image re- 
ceiving side. 

5 In a sixth embodiment, there will be explained a 
configuration in which the accounting process means in 
the first to third embodiments is provided both in the im- 
age providing side and in the image receiving side. 
In a seventh embodiment, there will be explained a 
10 configuration in which the accounting process means in 
the foregoing first to sixth embodiments is applied to the 
communication between equipment connected to a lo- 
cal area network. 

In an eighth embodiment, there will be explained a 
is configuration in which the accounting process means in 
the foregoing first to sixth embodiments is applied to the 
communication between equipment connected to a 
wide area network. 

In a ninth embodiment, there will be explained a 
20 configuration in which cypher means is combined with 
the accounting process means shown in the foregoing 
fourth to eighth embodiments, for protecting the infor- 
mation from theft or illegal alteration and realizing fair 
accounting. 

25 In a tenth embodiment, there will be explained ac- 
counting process means with a charge system in which 
charges are determined respectively for a case of trans- 
mitting all the MPEG data for an image and decoding 
an I frame only, a case of decoding an I frame and a P 
30 frame, and a case of decoding an I frame, a P frame and 
a B frame. 

In an eleventh embodiment, there will be explained 
a configuration in which cypher means is combined with 
the accounting process means in the foregoing first to 
35 tenth embodiments, for protecting the information from 
theft or illegal alteration and realizing fair accounting. 

In the following there will be explained the first em- 
bodiment of the present invention, with reference to the 
attached-drawings. Prior to the detailed description of 
40 the first embodiment, there will be given an explanation 
on the MPEG (Moving picture experts group) method 
employed for encoding for efficient storage and trans- 
mission of the moving picture information. 

The MPEG is an international standard designed for 
45 highly efficient encoding of the moving image and 
achieves a high efficiency in the encoding utilizing the . 
frequency characteristics of the data and the visual 
characteristics of human being, and also the redundan- 
cy in the time axis, specific to the moving image. 
so In the MPEG system, there are known MPEG1 with 
a maximum transfer rate of 1 .5 Mbpsforthe digital stor- 
age media, and MPEG2 designed for use all the trans- 
mission systems such as the bidirectional multimedia 
equipment, digital VCR, advanced television, optical fib- 
55 er network etc. without the upper limit in the transfer rate, 
but the basic algorithm is almost same for the both. In 
the following, therefore, there will be explained the en- 
coding principle and the data structure, principally taking 
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the MPEG1 as an example. 

At first there will be explained the principle of highly 
efficiency encoding by the MPEG system. In this encod- 
ing system, a high efficiency in the encoding can be re- 
alized by calculating the difference between the frames, 
thereby reducing the redundancy in the direction of time 
axis, and effecting DCT and variable-length encoding 
on thus obtained difference data, thereby reducing the 
redundancy in the spatial direction. 

The above-mentioned redundancy in the time axis 
can be reduced, in consideration of the high correlation 
among the continuous frames in the moving image, by 
calculating the difference between the frame to be en- 
coded and a preceding or succeeding frame. 

In the MPEG system, therefore, there are provided, 
as shown in Fig. 20, in addition to an intra-encoded pic- 
ture obtained by an encoding mode of effecting the en- 
coding within a frame, a preceding prediction encoded 
image (P-picture) obtained by encoding the difference 
from a frame preceding in time, and a bidirectional pre- 
diction encoded image (B-picture) obtained by encoding 
the one with the least data amount among the difference 
from a frame preceding in time, that from a frame suc- 
ceeding in time and that from an interpolated frame of 
the above-mentioned two frames, and the frames ob- 
tained by such encoding modes are combined in a pre- 
determined sequence. 

In the MPEG system, a unit or a GOP (group of pic- 
tures) is composed of an I -picture, 4 P-pictures and 10 
B-pictures, and there is recommended a combination of 
the l-picture at first, followed by repetition of two B-pic- 
tures and a certain number of P-pictures. The l-pictures 
is provided at a predetermined interval to enable special 
reproduction such as reverse reproduction and a partial 
reproduction utilizing the above-mentioned GOP as a 
unit, and also to prevent the propagation of the error 

In case a new object appears in the frame, the dif- 
ference from the succeeding frame may become small- 
er than that from the preceding frame. For this reason, 
the MPEG system effects the above-explained bidirec- 
tional prediction encoding to achieve a higher efficiency 
in the encoding. 

Also the MPEG system effects movement compen- 
sation by calculating the difference between a predeter- 
mined block (macroblock) containing 4 blocks of 8 x 8 
pixels each for the luminance data and 2 blocks for the 
color difference signals, and a macroblock in the vicinity 
of the corresponding block in the preceding or succeed- 
ing frame, then detecting a movement vector by search- 
ing a macroblock showing the least difference, and en- 
coding such movement vector as data. 

At the decoding operation, this movement vector is 
used for extracting the data of the corresponding mac- 
roblock in the preceding or succeeding frame, and such 
extracted data are used in decoding the data encoded 
•with movement compensation. 

In such movement compensation, the frame pre- 
ceding in time is once encoded and decoded to obtain 



the preceding frame, and the movement compensation 
is achieved by the macroblock in such preceding frame 
and that of the frame to be encoded. 

The movement compensation in the MPEG1 is con- 
5 ducted between the frames, but that in the MPEG2 is 
conducted between the fields. 

The difference data and the movement vector ob- 
tained by such movement compensation are further 
subjected to highly efficient encoding by the DCT trans- 
'0 formation and the Huffman encoding. 

In the following there will be explained the data 
structure of the MPEG system. 

The MPEG data have a hierarchic structure consist- 
ing, as shown in Fig. 21 , of a video sequence layer, a 
is GOP layer, a picture layer, a slice layer, a macroblock 
layer and a block layer. 

These layers will be explained in the following, start- 
ing from the lowermost one. 

The block layer is composed, as in the JPEG sys- 
20 tern, of blocks, each consisting of 8 x 8 pixels for the 
luminance data and the color difference data, and the 
DCT transformation is conducted in the unit of each 
block. 

The macroblock layer is composed of macroblocks, 
25 each consisting of 4 blocks of 8 X 8 pixels each for the 
luminance data and 1 block for each color data, associ- 
ated with a microblock header. In the MPEG system, this 
macroblock is used as the unit for the movement com- 
pensation and the encoding, as will be explained later. 
30 The above-mentioned macroblock header contains 
data of the movement compensation and the digitizing 
step in each macroblock unit, and data indicating wheth- 
er the six DCT blocks (Y0, Y1 , Y2, Y3, Cr, Cb) in each 
macroblock contain data. 
35 The slice layer is composed of one or more mac- 
roblocks consecutively arranged in the order of image 
scanning, and a slice header, and same quantizing 
steps can be employed for the macroblocks within the 
same slice layer. 
40 The above-mentioned slice header contains data 
relating to the quantizing steps within each slice layer, 
and same quantizing steps are applied within the same 
slice layer unless quantizing steps are provided specific 
to each macroblock. The first macroblock resets the dif- 
45 ference for the DC component. 

The picture layer contains a plurality of the slice lay- 
ers in the unit of a frame, and is composed of a header 
containing a picture start code etc. and one or more slice 
layers. The above-mentioned header contains a code 
50 indicating the image encoding mode and a code indicat- 
ing the precision (in the unit of a pixel or a half pixel) of 
the movement detection. 

The GOP layer is composed of a header including 
for example a group start code and a time code indicat- 
es ing the time from the start of sequence, and a plurality 
of h B- and P-frames. 

The video sequence layer starts with a sequence 
start code and ends with a sequence end code, between 
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which arranged are control data required for the decod- 
ing of the image size and the aspect ratio, and a plurality 
of GOP of a same image size. In the MPEG system of 
such data structure, the bit stream is defined by the 
standard thereof. Such encoding technology is already 
well known in the multimedia networks. 

In the MPEG system, as explained in the foregoing, 
the l-frame represents the approximate movement of 
the moving image independently from the P-or B-frame, 
while the P-frame, when decoded in combination with 
the l-frame, reproduces the smoother movement of the 
moving image. Also the B-frame, when decoded in com- 
bination with the I- and P-frames, allows to reproduce 
further smoother movement. 

In consideration of such features, the MPEG sys- 
tem can be considered an encoding system that deals 
with the image movement in hierarchic manner. The re- 
quired transmission capacity is larger for the transmis- 
sion of the I- and P-frames than for the transmission of 
the l-frame only, and even larger for the transmission of 
the I-, P- and B-frames. 

Therefore, for transmitting the MPEG data, there 
can be conceived a transmission method of at first ef- 
fecting the MPEG encoding for the image to be trans- 
mitted, then inspecting the state of use of the transmis- 
sion path, and, if there is a sufficient available capacity, 
transmitting all the frames of the image information. 

If the available capacity is not sufficient for transmit- 
ting all the frames, the I- and P-frames alone are trans- 
mitted. If the available capacity is even lower, the l-frame 
alone is transmitted. Such transmission technology is 
an important component technology in dealing with the 
multimedia data in the LAN (local area network) etc. 

The present embodiment is applied to an Image 
transmission system for transmitting the MPEG data 
through a transmission path, for selecting the frames of 
the MPEG data to be transmitted, in consideration of the 
feature of the MPEG data and according to the traffic in 
the transmission path, and for realizing accounting proc- 
ess means for effecting an accounting process with a 
charge system determined corresponding to the trans- 
mitted frames for each image. 

In the present embodiment, the MPEG data trans- 
mission mode is defined as a mode 1 in case of trans- 
mitting the l-frame only, a mode 2 in case of transmitting 
the i- and P-frames, and a mode.3 in case of transmitting 
the I-, P- and B-frames. 

Fig. 1 is a functional block diagram showing the 
principal parts of accounting process means in the im- 
age transmission system of the present invention, 
wherein accounting process means 100 is provided in 
the image transmission system. A control unit 101 fetch- 
es a request for image transmission from the user, trans- 
mitted in the image transmission system, accordingly 
controls a traffic check unit 102, a transmission mode 
selection unit 103 and an accounting unit 104, and in- 
forms the transmission mode selection unit 103 and the 
accounting unit 1 04 of an image identifier (name or code 



for identifying the image) requested therefrom. 

A traffic check unit 1 02 checks the currently availa- 
ble transmission capacity (traffic information) by moni- 
toring the image transmission system 110 (ortransmis- 
5 sion path) or inquiring the image transmission system 
110 of the information on the traffic status managed 
therein, and informs the transmission mode selection 
unit 103 of the result of such check. 

A transmission mode selection unit 103 receives 
fo the identifier of the requested image from the control unit 
101 and the traffic information of the image transmission 
system from the traffic check unit 102, selects a trans- 
mission mode for the image transmission according to 
the traffic information, and informs the accounting unit 
is 104 and the image transmission system 110 of such 
transmission mode. 

An accounting unit 104 fetches the image identifier 
from the control unit 101 and the transmission mode in- 
formation from the transmission mode selection unit 
20 1 03, reads a charge corresponding to such fetched in- 
formation from a storage unit 1 05 and informs the image 
transmission system 110 of such charge. 

A storage unit 105 stores the charge information of 
the image, to be referred to by the accounting unit 104. . 
25 An image transmission system 1 1 0 is composed of 
a network and terminals connected thereto with wires 
or with wireless connections, such as computers, re- 
ceivers, printers, monitors etc. It is to be noted that the 
above-explained functions need not necessarily be di- 
30 vided in the above-explained manner, and the plural 
functional blocks may be united in a functional block, or 
there may be provided plural blocks for any of the fore- 
going functions. 

In the following there will be explained an example 
35 of the traffic checking method in the traffic check unit 
102, in case the image transmission system 110 is re- 
alized with the ATM (asynchronous transfer mode). 

The traffic check unit 102 inquires the image trans- 
mission system 110 whether the transmission is possi- 
40 ble with a certain transfer rate Cr. If the image transmis- 
sion system 110 does not permit the transmission with 
such transfer rate Cr, the enquiry to the image transmis- 
sion system 110 for a transfer rate Cr smaller than Cr 
until the permission is given. On the other hand, if the 
45 image transmission system 110 permits the transmis- 
sion with the transfer rate Cr, it is set as the check value. 

However, in the image transmission system con- 
structed with other network systems, there may be em- 
ployed other traffic checking methods corresponding to 
so such network systems. Thus the traffic checking method 
of the present embodiment is not limited to the above- 
explained case of the ATM. 

In the following there will be explained an example 
of the transmission mode selecting method in the trans- 
ss mission mode selection unit 103. 

At first the transmission mode selection unit 103 re- 
ceives the information on the traffic status of the image 
transmission system 1 1 0 from the traffic check unit 1 02, 
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and also receives the identifier of the requested image 
from the control unit 101. 

Then it compares the transmission capacity re- 
quired for transmitting the requested image in each 
transmission mode with the traffic (available transmis- 
sion capacity) of the image transmission system, by 
making access to the storage unit 105 (of which stored 
information will be explained later with reference to Fig. 
3), and determines the transmission mode for the image 
transmission in the following manner. 

For the available transmission capacity Cr deter- 
mined by the traffic check unit 1 02 and for the transmis- 
sion capacities C1 , C2, C3 required for transmitting cer- 
tain MPEG data respectively in the transmission modes 
1 , 2 and 3, the transmission mode 3 is selected if Cr > 
C3. 

Also the transmission mode 2 is selected in case 
C3 > Cr > C2, and the transmission mode 1 is selected 
in case C2 > Cr ;> C1. In case of C1 > Cr, the image 
transmission system is informed of a fact that an enough 
transmission capacity cannot be obtained even in the 
transmission mode 1 . 

However, the function of the transmission mode se- 
lection unit 1 03 is not limited to the one explained above. 
For example it may execute the image transmission with 
a transmission mode i (i = 1, 2,...) for the transmission 
capacity Cr, even in case Cr is insufficient for the image 
transmission with such mode i (Cr < Ci) or it may wait 
until a sufficient capacity Cr £ Ci) can be obtained. 

Fig. 3 shows an example of the charge table stored 
in the storage unit 105. Fig. 3, indicates, example, the 
information Info 1 corresponds to a charge 11 in case it 
is provided with the transmission mode 1 and requires 
in such case a transmission capacity C11 . 

The table also indicates that the same information 
corresponds to a charge 12 when provided in the trans- 
mission mode 2 and requires a transmission capacity 
C 12, and that the same information corresponds to a 
charge 13 when provided in the transmission mode 3 
and requires a transmission capacity C1 3. 

In the following there will be explained the function 
of the accounting process means of the present embod- 
iment with the charge system determined for each trans- 
mission mode, in case a user (or a terminal of the user) 
requests an image Info 1 from the provider in a state 
where the image transmission system has an available 
transmission capacity Cr (C13 > Cr £ C12). 

In a first operation sequence, the control unit 101 
fetches information that the user requests the transmis- 
sion of the image Info 1 , by monitoring the messages 
exchanged in the image transmission system or by re- 
ceiving a message therefrom. 

Then, in a second operation sequence, the traffic 
check unit 102 checks the current traffic status of the 
image transmission system 110, thereby obtaining the 
available transmission capacity Cr. 

Then, in a third operation sequence, the control unit 
101 informs the transmission mode selection unit 103 



of the identifier of the requested image Info 1 . Also the 
traffic check unit 1 02 informs the transmission mode se- 
lection unit 1 03 of the above-mentioned available trans- 
mission capacity Cr. Also the transmission mode selec- 
5 tion unit 103 reads, from the storage unit 105, the trans- 
mission capacities required for transmitting the image 
Info 1 with the transmission modes, then compares 
these transmission capacities with the above-men- 
tioned available transmission capacity thereby deter- 
10 mining the transmission mode 2 corresponding to the 
traffic status, and informs the image transmission sys- 
tem 110 of the transmission mode. 

Then, in a fourth operation sequence, the control 
unit 1 01 informs the accounting unit 1 04 of the identifier 
is of the requested image Info 1, and the transmission 
mode selection unit 103 informs the accounting unit 104 
of the selected transmission mode 2. 

The accounting unit 104 reads, from the charge ta- 
ble stored in the storage unit 105 as shown in Fig. 3, the 
20 charge 12 corresponding to the image identifier Info 1 
informed from the control unit 101 and the transmission 
mode 2 informed from the transmission mode selection 
unit 1 03 and informs the charge to the image transmis- 
sion system 110. 
25 Fig. 2 is a block diagram showing a specific exam- 
ple of the configuration of the accounting process 
means 100 shown in Fig. 1. 

Referring to Fig. 2, accounting process means 200 
corresponds to the means 100 in Fig. 1. A CPU 201 
30 processes an input from an I/O interface 202 and sends 
instructions to the external units according to a program 
stored in a ROM 204 or a RAM 203. 

An I/O interface 202 is used for exchanging infor- 
mation with the image transmission system and for in- 
35 put/output with astorage device 206. A RAM 203 is used 
as a temporary memory for the CPU 201 and for pro- 
gram storage. 

A ROM 204 stores the program to be executed by 
the CPU 201 . It may however be dispensed with in case 
40 the program is fead from the outside of the accounting 
process means 200 or is stored in the RAM 203. 

A bus 205 is used for data exchange of the CPU 
201 - ROM 204. A storage device 206, for storing the 
charges for the respectively transmission modes for 
45 each image, can be composed, for example, of a mag- 
netic medium, an optical medium or a semiconductor 
device. 

The functions of the control unit 101, the traffic 
check unit 102, the transmission mode selection unit 
103 and the accounting unit 104 shown in Fig. 1 can be 
realized, in the configuration shown in Fig. 2, by the CPU 
201 , the I/O interface 202, the RAM 203, the ROM 204 
and the bus 205. 

For example, the control of the aforementioned op- 
eration sequences, the traffic checking, the transmis- 
sion mode selection and the accounting process are ex- 
ecuted by the CPU 201 , and the sequences and meth- 
ods therefore are stored in the RAM 203 or the ROM 
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204. The traffic checking in the first operation sequence, 
the informing of the transmission mode in the second 
operation sequence, and the informing of the charge in 
the fourth operation sequence are executed through the 
I/O interface 202. 

However the configuration realizing the functional 
blocks shown in Fig. 1 is not limited to that shown in Fig. 
2, and it is also possible to construct a part or all of the 
functional blocks shown in Fig. 1 into a single device. 
Also the operations are not limited to those explained in 
the foregoing, but the following operations are also in- 
cluded in the present embodiment. 

For example the second and third operation se- 
quences are united into a single sequence, and the 
transmission mode selection unit 103 reads the trans- 
mission capacity Ci required for transmitting the Info 1 
with a transmission mode i. This transmission capacity 
Ci is informed to the traffic check unit, which then in- 
spects whether the transmission can be made with such 
transmission mode i. 

If the transmission is not possible, the transmission 
mode selection unit 103 reads the transmission capacity 
required in a lower transmission mode (for example 
mode i-1). This operation is repeated, and, when the 
transmission is identified possible, the transmission 
mode selection unit informs the image transmission sys- 
tem and the accounting unit of thus identified transmis- 
sion mode. 

Otherwise, in the first operation sequence, the user 
designates the transmission mode at the request for im- 
age, and, if the image can be transmitted in the desig- 
nated transmission mode in the second to fourth oper- 
ation sequences, the transmission mode selection unit 
103 sends an instruction to transmit the data with the 
designated mode to the image transmission system, 
and the accounting unit 104 executes the accounting 
process in such transmission mode. 

In case the transmission is not possible, the trans- 
mission mode selection unit 1 03 either effects transmis- 
sion with an available rate, or waits until the transmis- 
sion becomes possible. Otherwise it informs the image 
transmission system of a process of transmission with 
a lowered transmission mode or of cancelling the re- 
quest. The accounting unit 104 effects an accounting 
process according to such process. 

In the following there will be explained a second em- 
bodiment of the present invention, with reference to the 
attached drawings. 

The present embodiment is applied to an image 
transmission system for transmitting the MPEG data 
through a transmission path, for selecting the frames of 
the MPEG data to be transmitted in consideration of the 
feature of the MPEG data and according to the traffic in 
the transmission path, also for determining a unit charge 
per unit amount of information according to the frames 
transmitted for each image, and for realizing accounting 
process means with a charge system for determining 
the charge based on such unit charge and the amount 



of information of the transmitted image. 

In the present embodiment, the MPEG data trans- 
mission mode is defined as a mode 1 in case of trans- 
mitting the l-frame only, a mode 2 in case of transmitting 
5 the I- and P-f rames, and a mode 3 in case of transmitting 
the I-, P- and B-f rames. In the following description, the 
explanation will be principally given to the parts different 
from those already explained in the foregoing drawings, 
and the explanation will not be given to the parts which 
10 are substantially same as those already explained. 

Fig. 4 is a functional block diagram showing the 
principal parts of accounting process means in the im- 
age transmission system of the present invention, and < 
corresponds to Fig. 1 in the first embodiment. 
75 Accounting process means 400 is provided in the 
image transmission system, corresponding to the ac- 
counting process means 100 in Fig. 1 . 

There are also provided a control unit 401 corre- 
sponding to the control unit 101 in Fig. 1 ; a traffic check 
20 unit 402 corresponding to the traffic check unit 102 in 
Fig. 1; a transmission mode selection unit 403 corre- 
sponding to the transmission mode selection unit 103 in 
Fig. 1 ; an accounting unit 404 corresponding to the ac- 
counting unit 104 in Fig. 1; a storage unit 405 for storing 
25 the charge information of the image to be referred to by 
the control unit 401 , and corresponding to the storage 
unit 105 in Fig. 1; and an image transmission system 
410 corresponding to the image transmission system 
110 in Fig. 1. 

30 A measuring unit 406, absent in the foregoing first 
embodiment, is provided for measuring the amount of 
the image information transmitted or received by the im- 
age transmission system 410. 

Fig. 6 shows an example of the charge table stored 
35 in the storage unit 402. Fig. 6 indicates, for example, the 
information Info 1 corresponds to a charge 11 per unit 
information amount when provided in the transmission 
mode 1, or a charge 12 per unit information amount 
when provided in the mode 2, or a charge 1 3 when pro- 
40 vided in the mode 3. 

In the following there will be explained the function 
of the accounting process means of the present embod- 
iment with the charge system of determining a charge 
per unit information amount for each transmission mode 
45 and determining the charge based on the unit informa- 
tion amount and the amount of information of the image, 
in case a user (or a terminal of the user) requests an 
image Info 1 from the provider in a state where the image 
transmission system has an available transmission ca- 
se pacity Cr (C1 3 > Cr Z C12). In the following description, 
the first to fou rth operation sequences will be omitted as 
they are same as those in the first embodiment. 

In the present embodiment, after the fourth opera- 
tion sequence explained in the foregoing, in a fifth op- 
eration sequence, the measuring unit 406 counts the 
amount of the information Info 1 during the transmission 
thereof in the image transmission system 410, and, after 
the transmission of the Info 1 , the accounting unit 404 
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determines the charge based on the unit charge 1 2 and 
the counted information amount and informs the image 
transmission system 410 of such determined charge. 

Fig. 5 is a block diagram showing a specific exam- 
ple of the configuration of the accounting process 
means 400 shown in Fig. 4. 

In Fig. 5, there are provided accounting process 
means 500 corresponding to that 200 in Fig. 2; a CPU 

501 corresponding to that 201 in Fig. 2; an I/O interface 

502 corresponding to that 202 in Fig. 2; a RAM 503 cor- 
responding to that 203 in Fig. 2; a ROM 504 correspond- 
ing to that 204 in Fig. 2; a bus 505 for data exchange by 
the CPU 501 - ROM 504, corresponding to the bus 205 
in Fig. 2; and a storage device 506 for storing the charge 
for the image for each transmission mode, correspond- 
ing to that 206 in Fig. 2. 

The functions of the control unit 401 , the traffic 
check unit 402, the transmission mode selection unit 
403 and the accounting unit 404 shown in Fig. 4 can be 
realized, in the configuration shown in Fig. 5, by the CPU 
501 , the I/O interface 502, the RAM 503, the ROM 504, 
the bus 505 and the measuring device 507 (however the 
measuring device 507 may be dispensed with in case 
of time measurement). 

This is same as in the first embodiment. In the 
present embodiment, at an arbitrary timing in the course 
of image transmission, the charge at such timing is de- 
termined by a method as in the fifth operation sequence, 
and the accounting unit 404 informs the image transmis- 
sion system of such charge. 

In the following there will be explained a third em- 
bodiment of the present invention, with reference to the 
attached drawings. 

The present embodiment is applied, in the forego- 
ing first and second embodiments, to enable the ac- 
counting of the charge at a predetermined interval, by 
calculating the cumulative charge. 

In the present embodiment, the MPEG data trans- 
mission mode is defined as a mode 1 in case of trans- 
mitting the l-f rame only, a mode 2 in case of transmitting 
the I- and P-f rames, and a mode 3 in case of transmitting 
the I-, P- and B-frames. 

Fig. 7 is a functional block diagram showing the ac- 
counting process means in the third embodiment, 
wherein provided are a control unit 701 corresponding 
to that 401 in Fig. 1 ; a traffic check unit 702 correspond- 
ing to that 402 in Fig. 4; a transmission mode selection 
unit 703 corresponding to that 403 in Fig. 4; an account- 
ing un it 704 corresponding to that 404 in Fig. 4; a storage 
unit 705 corresponding to that 405 in Fig. 4; and a meas- 
uring unit 706 corresponding to that 406 in Fig. 4. 

Figs. 9A and 9B illustrate examples of an accumu- 
lated charge table stored in the storage unit 705. Fig. 
9A shows the accumulated charge table in case the ac- 
counting process means 700 is provided at a terminal 
of the image provider side. The table shown in Fig. 9A 
indicates that, among the charges for the images pro- 
vided to a user A, a charge A alone still remains unac- 



counted, and that, among the charges for the images 
provided to a user B, a charge B alone still remains un- 
accounted. 

Also Fig. 9B shows the accumulated charge table 
5 in case the accounting process means is provided in a 
terminal at the user side. The table shown in Fig. 9B 
indicates that, among the charges for the images pro- 
vided by a provider A, a charge A alone still remains 
unaccounted and that, among the charges for the imag- 
10 es provided by a provider B, a charge B alone still re- 
mains unaccounted. 

In the following there will be explained the se- 
quence, executed by the accounting process means of 
the present embodiment, for determining the cumulative 
is sum of the charges determined from the unit charge and 
the amount of image information, in case a user L (or a 
terminal of the user) requests an image Info 1 from a 
provider A in a state where the image transmission sys- 
tem has an available transmission capacity Cr (C13 > 
20 Cr>C12). 

In the following description, the first to fifth operation 
sequences will be omitted as they are same as those 
explained in the foregoing. 

In the present embodiment, in a sixth operation se- 
25 quence after the end of the fifth operation sequence, the 
accounting unit 704 reads the accumulated charge for 
the user L from the storage unit 705, then adds the 
charge determined in the fifth operation sequence to the 
accumulated charge and stores the sum in the storage 
30 unit 705. 

Fig. 8 is a block diagram showing a specific exam- 
ple of the configuration of the accounting means corre- 
sponding to Fig. 7. 

In Fig. 8 there are provided accounting process 
35 means 800 corresponding to that 500 in Fig. 5; a CPU 

801 corresponding to that 501 in Fig. 5; an I/O interface 

802 corresponding to that 502 in Fig. 5; a RAM 803 cor- 
responding to that 502 in Fig. 5; a ROM 804 correspond- 
ing to that 504 in Fig. 5; a bus 805 for data exchange in 

40 the CPU 801 - ROM 804, corresponding to the bus 505 
in Fig. 5; and a storage device 806 for storing the charg- 
es for the respective transmission modes for each im- 
age, corresponding to the storage device 506 in Fig. 5. 
The functions of the control unit 701, the traffic 
45 check unit 702, the transmission mode selection unit 
703 and the accounting unit 704 shown in Fig. 7 can be 
realized, in the configuration shown in Fig. 8, by the CPU 
801, the I/O interface 802, the RAM 803, the ROM 804, 
the bus 805 and the measuring device 807 (however the 
50 measuring device 807 may be dispensed with in case 
of time measurement). 

This is same as in the first embodiment. In the 
present embodiment, at an arbitrary timing in the course 
of image transmission, the charge at such timing is de- 
55 termined by a method as in the fifth operation sequence, 
and the accounting unit 704 informs the image transmis- 
sion system of such charge. 

In the present embodiment, the charge table is 
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changed from the one shown in Fig. 6 to the one in Fig. 
3. Then, in the fourth operation sequence, the uniform 
charge for each image (charge 1 3) is read instead of the 
unit charge. Then the counting of the information 
amount is not conducted in the fifth operation sequence, 
and, in the sixth operation sequence, the sum of the ac- 
cumulated charge read in the fourth operation sequence 
and the charge 1 3 is set as a new accumulated charge. 

Then, at an arbitrary timing in the course of image 
transmission, the charge at such timing is determined 
by a method as in the fifth operation sequence, and the 
accounting unit 704 informs the image transmission sys- 
tem of such charge. 

Also the sixth operation sequence is conducted par- 
allel to the fou rth and fifth operation sequences. The fifth 
operation sequence does not inform the charge, and the 
sixth operation sequence informs the accumulated 
charge. 

In the following there will be explained a fourth em- 
bodiment of the present invention, with reference to the 
attached drawings. 

Fig. 10 is a block diagram where the accounting 
process means in the first to third embodiments is pro- 
vided at the side of the image provider (or the terminal 
thereof). 

In the present embodiment, the MPEG data trans- 
mission mode is defined as a mode 1 in case of trans- 
mitting the l-f rame only, a mode 2 in case of transmitting 
the I- and P-f rames, and a mode 3 in case of transmitting 
the I-, P- and B-frames. 

In Fig. 10, a transmission terminal 1001 is com- 
posed for example of a personal computer, a work sta- 
tion, a computer or an image transmitter of the image 
provider side, provided with the accounting process 
means. 

There are also shown accounting process means 
1002 shown in the foregoing first to third embodiments, 
and a receiving terminal 1003 composed for example of 
a personal computer, a work station, a computer or an 
image receiver of the user side. 

In the following there will be explained, with refer- 
ence to Fig. 1 1 , the function of the present embodiment 
employing the accounting process means of the second 
embodiment and the apparatus therefor, in case a user 
L (receiving terminal 1003) requests an image Info 1 to 
a provider (transmitting terminal 1001 ) in a state where 
the image transmission system has an available trans- 
mission capacity Cr (C13 > Cr> C12). 

At first, in a first operation sequence, the user L 
sends a message (image transmission requesting mes- 
sage) requesting the image Info 1 to the provider A 
through the transmission path. Upon reception of this 
message in the terminal 1 001 of the provider A, the ac- 
counting process means 1002 fetches the message 
from the transmission terminal 1001 . 

Then, in a second operation sequence, the ac- 
counting process means 1002 inspects the traffic of the 
transmission path through the transmission terminal 



1001 to obtain the available transmission capacity Cr, 
then compares the available transmission capacity Cr 
with C1 1 - C1 3 by referring to the charge table shown in 
Fig. 6, thereby determining the transmission mode 2 for 
5 the transmission of the Info 1 and informs the transmis- 
sion terminal 1001 of such transmission mode 2. 

Then, in a third operation sequence, the transmis- - 
sion terminal 1001 transmits the Info 1 to the user L in 
the mode 2, through the transmission path. At the same 
io time, the accounting process means 1 002 measures the 
amount of information of the Info 1 transmitted by the 
transmission terminal 1001. 

In a fourth operation sequence, the accounting 
process means 1002 monitors the Info 1 under trans- 
is mission, and, upon confirming the end of transmission 
of the Info 1 either by detecting a bit pattern indicating 
the end of the image or by receiving a message from 
the transmission terminal 1001 to the user L, indicating 
the end of transmission of the Info 1, reads the unit 
20 charge 12 from the charge table shown in Fig. 6 and 
determines the charge to the user L, based on the 
amount of information of the Info 1 provided to the user 
Land the unit charge 12. 

Then, in a fifth operation sequence, the accounting 
25 process means 1002 sends the charge, determined in 
the fourth operation sequence, to the transmission ter- 
minal 1001. 

In a sixth operation sequence, the charge payment 
is executed. 

30 The following operations are also included in the 
present embodiment. 

At first, in the first operation sequence, the user also 
designates the transmission mode, at the request of the 
Image. If the transmission capacity Cr enough for the 
35 transmission with the designated transmission mode 
cannot be obtained, the accounting process means ei- 
ther effects transmission with the designated transmis- 
sion mode and with the transmission capacity Cr, or 
waits until a sufficient transmission capacity is obtained, 
40 or effects transmission with a transmission mode per- 
mitted within the transmission capacity Cr. 

Otherwise it sends, to the image transmission ap- 
paratus, an instruction for example of cancelling the re- 
quest and effects an accounting process corresponding 
45 to such instruction. At the same time the image trans- 
mitting apparatus effects a process of image transmis- 
sion or request cancellation with the image receiving ap- 
paratus. The above-mentioned process options may be 
asked to and selected by the user. 
so in another operation mode, at the first operation se- 
quence, the user also designates a terminal (or an im- 
age processing apparatus) as the destination of the im- 
age, at the request for the image to the image provider, 
and the provider A transmits the image information to 
ss thus designated destination. 

In the third operation sequence, the unit charge 12 
is read and the charge to such timing is calculated from 
the unit charge 12 and the amount of information up to 
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such timing. Then the calculated charge is sent to the 
transmission terminal 1 001 for information to the provid- 
er A and the user L 

In the fourth operation sequence, the read unit 
charge 12 is supplied to the transmission terminal 1001 
which further transmits the unit charge 12 to the user L 
through the transmission path. 

Then, in the fifth operation sequence, the transmis- 
sion terminal 1001 informs the user L of the above-men- 
tioned charge through the transmission path. 

The accounting process means 1002 is realized by 
the CPU, memory, storage device etc. provided in the 
transmission terminal 1001. 

In addition to the foregoing examples, the present 
embodiment also includes such variations as the appli- 
cation of the accounting process means of the first or 
third embodiment. 

In the following there will be explained a fifth em- 
bodiment of the present invention, with reference to the 
attached drawings. 

Fig. 12 is a block diagram where the accounting 
process means in the first to third embodiments is pro- 
vided at the side of the user (or the terminal thereof). 

In the present embodiment, the MPEG data trans- 
mission mode is defined as a mode 1 in case of trans- 
mitting the I -frame only, a mode 2 in case of transmitting 
the I- and P-f rames, and a mode 3 in case of transmitting 
the I-, P- and B-frames. 

In Fig. 12, there are shown a transmission terminal 
1201 composed for example of a personal computer, a 
work station, a computer or an image transmitter of the 
image provider side, provided with the accounting proc- 
ess means; accounting process means 1202 shown in 
the foregoing first to third embodiments; and a receiving 
terminal 1 203 composed for example of a personal com- 
puter, a work station, a computer or an image receiver 
of the user side. 

In the following there will be explained, with refer- 
ence to Fig. 1 3, the function of the present embodiment 
employing the accounting process means of the second 
embodiment, in case a user L (receiving terminal 1 203) 
requests an image Info 1 to a provider A (transmission 
terminal 1201 ) in a state where the image transmission 
system has an available transmission capacity Cr (C13 
>Cr>C12). 

At first, in a first operation sequence [S1], the user 
L generates, within the receiving terminal 1203, a mes- 
sage requesting the transmission of the image Info 1 to 
the provider A (image transmission requesting mes- 
sage). The accounting process means 1 202 fetches this 
message from the receiving terminal 1203. 

Then, in a second operation sequence [S2], the ac- 
counting process means 1 202 inspects the traffic of the 
transmission path through the receiving terminal 1203 
to obtain the available transmission capacity Cr, then 
compares the available transmission capacity Cr with 
C1 1 to C1 3 by referring to the charge table shown in Fig. 
6, thereby determining the transmission mode 2 for the 



transmission of the Info 1 and informs the receiving ter- 
minal 1203 of such transmission mode 2. 

The receiving terminal 1203 informs the transmis- 
sion terminal 1201, through the transmission path, of a 
5 fact that "the user L requests the transmission of the im- 
age Info 1 in the transmission mode 2 to the provider A". 

Then, in a third operation sequence [S3], in re- 
sponse to the informing from the receiving terminal 
1203, the transmission terminal 1201 transmits the Info 
10 1 to the user L through the transmission path, in the 
transmission mode 2. At the same time the accounting 
process means 1 202 measures the amount of informa- 
tion of the I nfo 1 received by the receiving terminal 1 203. 
Then, in a fourth operation sequence [S4], the ac- 
is counting process means 1^2 monitors the Info 1 under 
reception, and confirms the end of transmission of the 
Info 1 either by detecting a bit pattern indicating the end 
of the image or by receiving a message from the receiv- 
ing terminal 1203 indicating the end of reception of the 
20 Info 1 from the provider A. 

Upon confirming the end of reception in the above- 
explained manner, the accounting process means 1202 
reads the unit charge 12 from the charge table shown 
in Fig. 6, then determines the charge to be charged by 
25 the provider A, based on the amount of information of 
the Info 1 received from the provider A and the unit 
charge 12, and transmits such charge to the receiving 
terminal 1203. 

In a fifth operation sequence [S5], the charge pay- 
30 rnent is executed. 

The following case is also included in the present 
embodiment. 

At first, in the first operation sequence, the user also 
designates the transmission mode, at the request of the 
35 image. 

If the transmission capacity Cr enough for the trans- 
mission with the designated transmission mode cannot 
be obtained, the accounting process means 1202 ef- 
fects transmission with the designated transmission 
40 mode and with the available transmission capacity Cr, 
or waits until a sufficient transmission capacity is ob- 
tained, or effects transmission with a transmission mode 
permitted within the transmission capacity Cr. 

Otherwise it sends, to the image receiving appara- 
45 tus, an instruction for example of cancelling the request 
and effects an accounting process corresponding to 
such instruction. At the same time the image receiving 
apparatus effects a process of image transmission or 
requests cancellation in cooperation with the image 
50 transmission apparatus. 

The above-mentioned process options may be 
asked to and selected by the user. 

In another operation mode, at the first operation se- 
quence, the user also designates a terminal (or an im- 
55 age processing apparatus) as the destination of the im- 
age, at the request for the image to the image provider, 
and the image provider A transmits the image informa- 
tion to thus designated destination. This operation in- 
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eludes following two cases. 

In a first case, the accounting process means be- 
longs to the user. In this case, the user (or the account- 
ing process means thereof) receives a notice indicating 
the start of image transmission from the destination or 
the image provider, at the start of image providing prior 
to the third operation sequence, and initiates the ac- 
counting process. 

Also in the fourth operation sequence, the account- 
ing operation is terminated in response to a notice indi- 
cating the end of image transmission. Also the amount 
of image information is informed to the user from the 
destination or the image provider. 

In a second case, the accounting process means 
belongs to the destination designated by the user. In this 
case, the user sends, in the first operation sequence, 
the image transmission requesting message also to the 
destination, of which accounting process means fetches 
this message. The accounting process means of the 
destination informs the provider or the user of the charge 
in the fourth operation sequence. 

In the first operation sequence, the receiving termi- 
nal 1203 transmits the image transmission requesting 
message, and the transmission terminal 1201 selects 
the transmission mode 2 in the same manner as in the 
accounting process means 1 202. 

In the third operation sequence, the unit charge 12 
is read, then the charge to such timing is calculated, 
based on the unit charge 1 2 and the amount of informa- 
tion Info 1 received up to such timing, and thus calcu- 
lated charge is supplied to and displayed on the receiv- 
ing terminal 1203, as information to the user L 

In addition, the present embodiment also includes 
such variations as realizing the accounting process 
means i 202 by means of the CPU, memory, storage de- 
vice etc. provided in the receiving terminal 1203, or as 
applying the accounting process means of the first or 
third embodiment. 

In the following there will be explained a sixth em- 
bodiment of the present invention, with reference to the 
attached drawings. 

Fig. 14 is a block diagram where the accounting 
process means in the first to third embodiments is pro- 
vided both at the image provider (or the terminal thereof) 
and at the user (or the terminal thereof). 

In the present embodiment, the MPEG data trans- 
mission mode is defined as a mode 1 in case of trans- 
mitting the l-f rame only, a mode 2 in case of transmitting 
the I - and P-f rames, and a mode 3 in case of transmitting 
the I-, P- and B-frames. 

In Fig. 14, there are shown a transmission terminal 
1401 composed for example of a personal computer, a 
work station, a computer or an image transmitter of the 
image provider side, provided with the accounting proc- 
ess means; accounting process means 1402 shown in 
the foregoing first to third embodiments; a receiving ter- 
minal 1403 composed for example of a personal com- 
puter, a work station, a computer or an image receiver 



of the user side provided with the accounting process 
means; and accounting process means 1404 shown in 
the foregoing first to third embodiments. 

In the following there will be explained, with refer- 
5 ence to Fig. 1 5, the function of the present embodiment 
employing the accounting process means of the second 
embodiment and the apparatus therefor, in case a user 
L (receiving terminal 1403) requests an image Info 1 to 
a provider A (transmission terminal 1401) in a state 
10 where the image transmission system has an available 
transmission capacity Cr (C1 3 > Cr > C1 2). 

At first, in a first operation sequence [S1 ], the user 
L transmits, to the provider A (transmission terminal 
1401) through the transmission path, a message re- 
is questing the transmission of the image Info 1 (image 
transmission requesting message). The accounting 
process means 1 404 fetches this message from the re- 
ceiving terminal 1403. Also when the message is re- 
ceived by the transmission terminal 1401 , the account- 
20 ing process means 1402 thereof fetches the message 
from the transmission terminal 1401 . 

Then, in a second operation sequence [S2], the ac- 
counting process means 1 402 inspects the traffic of the 
transmission path through the transmission terminal 
25 1401 to obtain the available transmission capacity Cr, 
then compares the available transmission capacity Cr 
with C11 to C13 by referring to the charge table shown 
in Fig. 6, thereby determining the transmission mode 2 
for the transmission of the Info 1 and informs the trans- 
30 mission terminal 1 401 of such transmission mode 2. 

Similarly the accounting process means 1404 de- 
termines the transmission mode 2 and informs the re- 
ceiving terminal 1403 of such mode. 

Then, in a third operation sequence [S3], thetrans- 
35 mission terminal 1401 transmits the Info 1 through the 
transmission path to the receiving terminal 1403 in the 
transmission mode 2. The accounting process means 
1402 measures the amount of the information Info 1 
transmitted by the transmission terminal 1 401 . 
40 The receiving terminal 1403 receives the Info 1, 
transmitted through the transmission path. The account- 
ing process means 1404 measures the amount of the 
information Info 1 received by the receiving terminal 
1403. 

45 Then, in a fourth operation sequence [S4], the ac- 
counting process means 1402 monitors the Info 1 under 
transmission, and, upon confirming the end of transmis- 
sion of the Info 1 to the user L either by detecting a bit 
pattern indicating the end of the image or by receiving 
so a message from the transmission terminal 1401 indicat- 
ing the end of transmission of the Info 1 to the user L, 
reads the unit charge 12 from the charge table shown 
in Fig. 6. It then calculates the charge to the user L, 
based on the unit charge 1 2 and the amount of inf orma- 
55 tion Info 1 provided to the user L, and informs the trans- 
mission terminal 1 401 of such charge. Also the account- 
ing process means 1404 monitors the Info 1 under re- 
ception, and, upon confirming the end of reception of 
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the Info 1 trom the provider A either by detecting a bit 
pattern indicating the end of the image or by receiving 
a message from the receiving terminal 1403 indicating 
the end of reception of the Info 1 from the provider A, 
reads the unit charge 12 from the charge table shown 
in Fig. 6. 

It then calculates the charge, to be charged by the 
provider A, based on the unit charge 1 2 and the amount 
of the information Info 1 received Irom the provider A, 
and informs the receiving terminal 1 403 of such charge. 

In a fifth operation sequence [S5], the charge pay- 
ment is executed. 

The following case is also included in the present 
embodiment. 

At first, in the first operation sequence [S1], the user 
also designates the transmission mode, at the request 
of the image. 

If the transmission capacity Cr enough for the trans- 
mission with the designated transmission mode cannot 
be obtained, the accounting process means 1402 (or 
1404) effects transmission with the designated trans- 
mission mode and with the available transmission ca- 
pacity Cr, or waits until a sufficient transmission capacity 
is obtained, or effects transmission with a transmission 
mode permitted within the transmission capacity Cr. 

Otherwise it sends, to the image transmission ap- 
paratus (or image receiving apparatus in case of the ac- 
counting process means 1 404), an instruction for exam- 
ple of cancelling the request and effects an accounting 
process corresponding to such instruction. At the same 
time, the image transmission apparatus and the image 
receiving apparatus effect a process of image transmis- 
sion or request cancellation according to such instruc- 
tion. The above-mentioned process options may also be 
asked to and selected by the user. 

In another operation mode, at the first operation se- 
quence, the user also designates a terminal (or an im- 
age processing apparatus) as the destination of the im- 
age, at the request for the image to the image provider, 
and the image provider A transmits the image informa- 
tion to thus designated destination. This operation in- 
cludes following two cases. 

In a first case, both the provider and the user are 
provided with {the accounting process means. In this 
case, the user (or the accounting process means there- 
of) receives a notice indicating the start of image trans- 
mission from the destination or the image provider, at 
the start of image providing prior to the third operation 
sequence, and initiates the accounting process. Also in 
the fourth operation sequence, the accounting operation 
is terminated in response to a notice indicating the end 
of image transmission. Also the amount of image infor- 
mation is informed to the user from the destination or 
the image provider. 

In a second case, the accounting process means 
are provided both at the provider and the destination 
designated by the user. In this case, the user sends, in 
the first operation sequence, the image transmission re- 



questing message also to the destination, of which ac- 
counting process means fetches this message. The ac- 
counting process means of the destination may inform 
the user of the charge in the fourth operation sequence 
5 [S4]. 

Also in the second operation sequence [S2], the ac- 
counting process means 1 402 reads the unit charge 1 2, 
and informs it to the transmission terminal for display 
thereon for the provider A. 
10 Also in the second operation sequence [S2], the ac- 
counting process means 1 404 reads the unit charge 1 3, 
and informs it to the receiving terminal 1403 for display 
thereon for the user L. 

In the third operation sequence, the accounting 
is process means 1 404 reads the unit charge 1 2, then cal- 
culates the current charge based on the unit charge 12 
and the amount of the information Info 1 received up to 
such timing, and sends such charge to the receiving ter- 
minal 1403. 

20 It is also possible to realize the accounting process 
means 1 402 by means of the CPU, memory, storage de- 
vice etc. provided in the transmission terminal 1401 , to 
realize the accounting process means 1404 by means 
of the CPU, memory, storage device etc. provided in the 
25 receiving terminal 1 403, or to apply the accounting proc- 
ess means of the first or third embodiment. 

The networks utilizing the accounting process 
means explained in the foregoing constitute embodi- 
ments of the present invention, but a particularly pre- 
30 ferred embodiment utilizing the accounting process 
means of the present invention will be explained in the 
following. 

Now a seventh embodiment of the present invention 
will be explained with reference to the attached draw- 
35 ings. 

Fig. 16 is a block diagram showing the entire con- 
figuration of a network of the present embodiment. 

In Fig. 16 there is shown an ATM network 1601 for 
data transmission with an ATM (asynchronous transfer 
40 mode) to be explained later. 

There are also shown local area networks (LAN) 
1 602, 1 603, composed for example of Ethernet, for data 
transfer in modes other than the ATM. These networks 
1601, 1602, 1603 are connected to following various ap- 
45 paratus. 

There are shown a facsimile apparatus 1604, a 
color printer 1 605 provided therein with a page memory, 
a color copying apparatus 1606 including a color scan- 
ner, a color printer, a page memory for storing the orig- 
inal image data read by the color scanner, and a circuit 
for reading the image data from the page memory for 
supply to the color printer, a file server 1607 for tempo- 
rarily storing the image data entered through the ATM 
network, and a work station 1608 for data input/output 
of the file server. 

A terminal 1 609 connected to the ATM network also 
effects data exchange with the local area networks 
1602, 1603 and effects various processing such as im- 
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age data editing. The terminal 1 609 is connected to the 
printer 1605 etc. mentioned above, through the network 
1603 or exclusive lines. 

A server 1610, similar to the server 1607, is con- 
nected to a color copying apparatus 1 61 1 which is sim- 
ilar to the color copying apparatus 1606. 

A digital television 1612, connected to the ATM net- - 
work receives data therethrough and displays such re- 
ceived data. 

There are also shown a VCR 1 61 3 receiving the im- 
age data through the ATM network; a center station 
1614 such as a CATV station for sending various soft- 
ware data and image data to the ATM network; a first 
router 1615 for connecting the ATM network to another 
ATM network; and a second router 1616 for connection 
with another local area network. 

Also unrepresented ATM network switches are pro- 
vided between the ATM network and the equipment con- 
nected thereto, such as the facsimile apparatus 1604, 
the printer 1605 and the color copying apparatus 1607. 
These equipment are provided, if necessary, with the 
accounting process means as shown in the foregoing 
first to third embodiments. 

The accounting operation in the above-explained 
configuration will be explained in the following with ref- 
erence to Fig. 17, in case the center station 1614 is pro- 
vided with the accounting process means (fourth em- 
bodiment) and the user terminah 609 sends the request 
to the transmission center station 1614, designating the 
digital television 1612 as the destination of the image. 

At first, in a first operation sequence [S1], the ter- 
minal 1609 sends a request for transmission to the cent- 
er station 1614, designating the requested image, the 
transmission mode therefor and the digital television 
1 61 2 as the destination. The accounting process means 
fetches his request from the center station 1614, which 
has received this request. 

Then, in a second operation sequence [S2], the 
center station 1614 transmits the image data to the dig- 
ital television 1612, which receives thus transmitted da- 
ta. In this sequence, the accounting operation is execut- 
ed as explained in the foregoing fourth embodiment, 
whereby the charge to be paid by the terminal 1609 (or 
the user thereof) to the center station 1614 is derived. 

Then, in a third operation sequence [S3], if the ter- 
minal 1609 or the digital television 1612 wishes to ter- 
minate the data reception in the course thereof, a re- 
quest for terminating the transmission is sent to the cent- 
er station 1614. 

Then, in a fourth operation sequence, in response 
to such request for terminating the transmission, the 
center station 1614 terminates the supply of the image 
data. Detecting such termination, the accounting proc- 
ess means terminates the accounting operation. 

Then, in a fifth operation sequence [S5], the center 
station 1614 informs the terminal 1 609 of the charge de- 
rived by the accounting process means. 

In a sixth operation sequence [S6], the charge pay- 



ment is executed between the center station 1614 and 
the terminal 1609. In case of bidirectional data transfer, 
the accounting is similarly executed with the inversion 
of the transmitting and receiving sides. 
5 The present embodiment also includes the follow- 
ing cases. 

In case the accounting process means is not.pro- 
vided in the center station 1 61 4 but in the terminal 1 609, 
in the first operation sequence [S1], the accounting 

10 process means fetches the request for transmission 
from the terminal 1609. 

Also at the start of image providing, a message 
therefor is transmitted from the center station 1614 or 
the digital television 1612 to the terminal 1609, and, at 

15 the end of the image providing, a message therefor is 
transmitted from the center station 1614 or the digital 
television 1612 to the terminal 1609. 

Upon detecting the message indicating the start of 
image providing, the accounting process means initi- 

20 ates the accounting operation as in the fourth embodi- 
ment, and, upon detecting the message indicating the 
end of image providing, terminates the accounting op- 
eration. In such case, the fifth operation sequence [S5] 
in this embodiment is omitted. 

25 In case the accounting process means is not pro- 
vided in the center station 1 614 or the terminal 1609 but 
in the digital television 1612, in the first operation se- 
quence [S1], the accounting process means fetches the 
request for transmission from the digital television 1612. 

30 The accounting operation is conducted as ex- 
plained in the foregoing fifth embodiment, and, in the 
fifth operation sequence [S5] of the present embodi- 
ment, the charge is informed from the digital television 
1612 to the center station 1614 and/or the terminal 

35 1609. 

Also the function in case the accounting process 
means are provided at least in both the center station 
1614 and the terminal 1609 will be apparent from the 
sixth embodiment. It will thus be apparent that the ac- 

40 counting on the data exchange can be achieved not only 
between the center station and the digital television but 
also among other terminals. 

In the following there will be explained an eighth em- 
bodiment of the present invention, with reference to the 

45 attached drawings. 

Fig. 18 is a view showing an example of the multi- 
media network system in which the present invention is 
applicable, wherein shown are a B-ISDN network 1801 
utilizing high-speed public lines; a cable television 

50 (CATV) network 1802; local area networks (LAN) 1803, 
1804; and a communication satellite 1805. 

There are also shown ground stations 1811, 1812 
for effecting information communication through the 
communication satellite; information providers 1821, 

55 1822 providing various multimedia information including 
image and voice information through such communica- 
tion networks and receiving the charges therefor; and 
users 1831 to 1839 utilizing the information provided 
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from the information providers and paying the charges 
therefor. 

The B-ISDN network 1 801 , the CATV network 1802, 
the LAN's 1803, 1804 and the communication satellite 
1805 are mutually connected to enable mutual (bidirec- 
tional) information exchange. The information providers 
1 821 , 1 822 and the users 1 831 to 1 839 are respectively 
connected to these communication networks. The infor- 
mation providers 1821, 1822 are respectively provided 
with the accounting process means as shown in the 
foregoing first to third embodiments. 

However, since the bidirectional communication is 
possible, the information provider may become a user 
and the user may become an information provider if the 
accounting process means are provided both in the in- 
formation providers 1821, 1822 and in the users 1831 
to 1839. Also the above-mentioned accounting process 
means may be incorporated in each equipment, or pro- 
vided between each equipment and the network, or ex- 
ternally attached to each equipment. 

The function of the present embodiment will be ex- 
plained in the following, with reference to Fig. 1 9, in case 
the information providers alone are provided with the ac- 
counting process means, taking a case that the user 
1839 requests the information from the provider 1821 
and the provider 1821 charges to the user 1839 accord- 
ing to the information provided thereto. 

In the following description, the transmission path 
indicates the second LAN 1B04, the B-ISDN network 
1801 , the CATV network 1802 and the first LAN 1803. 

At first, in a first operation sequence [S1], the user 
1 839 sends a request for the image transmission, to the 
information provider 1821 through the transmission 
path. 

Then, in a second operation sequence [S2], in re- 
sponse to the request from the user 1839, the provider 
1821 provides the user 1839 with the MPEG encoded 
image information through the transmission path. In this 
operation, there is executed the accounting operation 
as already explained in the fourth embodiment. 

Then, in a third operation sequence [S3], the user 
1839, if wishing to interrupt the image transmission in 
the course thereof, sends a request for terminating the 
transmission. 

In a fourth operation sequence [S4], in response to 
such request, the information provider terminates the 
image transmission. Also the accounting process 
means terminates the accounting operation mentioned 
above. 

Then in a fifth operation sequence [S5], the charge 
payment is executed. In case the user is provided with 
the accounting process means is the above-explained 
network, the function of the accounting process means 
is conducted according to the fifth embodiment. Also in 
case the provider and the user have the accounting 
process means, the function is conducted as in the sixth 
embodiment. 

As will be apparent from the foregoing, the account- 



ing to other users or other providers is similarly possible. 

In the following there will be explained a ninth em- 
bodiment of the present invention. 

In the transmission of information (image request- 
5 ing signal, image information, accounting information 
etc.) between a transmitting station and a receiving sta- 
tion through a transmission path, there may result illegal 
deeds such as: 

10 1 . Reception of the image information by a third par- 
ty without charge payment; 

2. Request for and reception of the information by 
a third party pretending another receiving station; 

3. Alteration of the charge-requesting information 
15 by the receiving station, after the reception of the 

information; and 

4. Forgery of the receipt information by the receiving 
station, without charge payment. 

20 As a countermeasure for such illegal deed, follow- 
ing cypher means may be combined with the accounting 
process means as shown in the first to eighth embodi- 
ments or the system utilizing the same. 

In such case, in the configuration shown in Fig. 10, 

25 12 or 14, the cypher means explained in the following 
may be provided on the transmission terminal and the 
receiving terminal. 

It is also possible to assign encypher/decyphering 
means to each hierarchic layer of the image data and to 

so include the operation time of such encypher/decypher- 
ing means and the amount of image information proc- 
essed by the encypher/decyphering means in the 
charge calculation. 

In the following there will be explained a tenth em- 

35 bodimentof the present invention. In contrast to the fore- 
going embodiments in which the necessary frames 
alone are transmitted, the present embodiment trans- 
mits all the frames of the MPEG data. The receiving side 
(user) only decodes the necessary frames, and the ac- 

40 counting is conducted according to thus decoded 
frames. 

Consequently, in the present embodiment, the ac- 
counting process means is principally provided in the 
receiving side. In the present embodiment, the MPEG 
45 data decoding mode is defined as a mode 1 in case of 
decoding the I -frame only, a mode 2 in case of decoding 
the I- and P-f rames, and a mode 3 in case of decoding 
the I-, P- and B-f rames. 

The accounting means in the present embodiment 
so js substantially same as that in any of the foregoing em- 
bodiments, but is adapted to: 

1) manage the above-mentioned decoding modes 
instead of the transmission modes; and 
55 2) effect the accounting process by detecting the 
decoding mode, by monitoring the decoding mode 
employed by the user for decoding the MPEG data. 
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Also MPEG decoding means for decoding the 
MPEG data with a designated decoding mode can be 
realized with a known MPEG decoding device. The 
present embodiment also includes a case where the ac- 
counting means is provided at the transmission side. 

In the following there will be explained an eleventh 
embodiment of the present invention. In the transmis- 
sion of information (image requesting signal, image in- 
formation, accounting information etc. ) between a 
transmitting station and a receiving station through a 
transmission path, there may result illegal deeds such 
as: 

1 . Reception of the image information by a third par- 
ty without charge payment; 

2. Request for and reception of the information by 
a third party pretending another receiving station; 

3. Alteration of the charge-requesting information 
by the receiving station, after the reception of the 
information; and 

4. Forgery of the receipt information by the receiving 
station, without charge payment. 

As a countermeasure for such illegal deed, follow- 
ing cypher means may be combined with the accounting 
process means as shown in the first to tenth embodi- 
ments. In such case, in the configuration shown in Fig. 
12, 14 or 16, the cypher means explained in the follow- 
ing may be provided in the transmission terminal and 
the receiving terminal. 

In the present embodiment, the MPEG data decod- 
ing mode is defined as a mode 1 in case decoding the 
l-frame only, a mode 2 in case of decoding the I- and P- 
frames, and a mode 3 in case of decoding the I-, P- and 
B-frames. 

In particular the present embodiment, utilizing the 
foregoing first to tenth embodiment, is capable not only 
of encyphering the MPEG data for transmission but also 
of realizing the following accounting system. 

At first, as shown in Fig. 22, the transmitting side 
encyphers the l-frame with a cypher key Ki, the P-f rame 
with a key Kp and the B-f rame with a key Kb. 

In case the user (or the terminal thereof) wishes the 
mode 1 , the transmitting side informs the user of the key 
Ki or a decyphering key corresponding thereto. 

In case the user wishes the mode 2, the transmitting 
side informs the user of the keys Ki and Kp or decypher- 
ing keys corresponding thereto. 

I n case the user wishes the mode 3, the transmitting 
side informs the user of the keys Ki and Kp and Kb, or 
decyphering keys corresponding thereto, and then the 
encyphered MPEG data are transmitted. In this opera- 
tion, the transmitting side executes an accounting proc- 
ess corresponding to the decyphering keys informed to 
the user. 

The present embodiment also includes a case in 
which the amount of information subjected to the decy- 
phered operation, the number of encyphering or decy- 
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phering operations, the operation time of the encypher- 
ing or decyphering means etc. are reflected on the 
charge. 

Also in order to always inform only one key to the 

5 user, for the user wishing the mode 1 , the transmitting 
side encyphers the l-frame with a cypher key K1 and the 
I- and P-frames with a key K2 and informs the user of 
the key K1 or a decyphering key corresponding thereto. 
Also for the user wishing the mode 2, the transmit- 

10 ting side encyphers the I- and P-frames with a key K1 
and the B-frame with a key K2, and informs the user of 
the key K1 or a decyphering key corresponding thereto. 
For the user wishing the mode 3, the transmitting side 
encyphers the I-, P- and B-frames with a key K and in- 

is forms the user of the key K or a decyphering key corre- 
sponding thereto. Such operation mode is also included 
in the present embodiment. 

The cypher technology can be generally classified 
into a common key cypher system and an open key cy- 

20 pher system to be explained in the following. 

In the common key cypher system, a same cypher 
key is secretly owned by the transmitter and the receiver 
(also called secret key cypher system, symmetrica! cy- 
pher system etc.). 

25 The common key cypher system can be classified 
into a block cypher in which the encyphering is executed 
with a same key for every block of characters of a suit- 
able length, and a stream cypher in which the key is 
changed for every block of characters or for every bit. 

30 in the above-mentioned block cypher, there are known 
a mutation cypher in which the encyphering is achieved 
by mutating the order of characters, and a replacement 
cypher in which each character is replaced by another 
character. 

35 in these cypher systems, a correspondence table 
for mutation or replacement constitutes the cypher key. 
In the stream cypher, there are known Visinel code em- 
ploying multiple tables, and Vernum code employing a 
key used only once. (Details of these cypher systems 

40 are described by Ikeno and Oyama, "Modern cypher 
theory", Electronic Information Communication Associ- 
ation, 1 986, Chapters 2 and 4.) 

Among the block cypher systems, some systems of 
which algorithms are already disclosed, such as DES 

45 (Data Encryption Standard) or FEAL (Fast data Enci- 
pherment Algorithm) are widely used as the commercial 
cypher systems. (For details, seeTsujii, Kasahara, "Cy- 
pher and information security", Shokodo, 1990, Chapter 
2.) 

50 The open key cypher system employs an encypher- 
ing key and a decyphering key which are mutually dif- 
ferent, wherein the encyphering key is made open but 
the decyphering key is kept secret. Such open key cy- 
pher system is featured by: 

55 

1 ) As the encyphering key is different from the de- 
cyphering key and can be made open, the delivery 
of the key is made easy; 
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2) As the encyphering key of each user is made 
open, each user is only required to keep the decy- 
phering key secret; and 

3) There can be realized a confirming function, for 
the receiver to confirm that the transmitter of the 
transmitted text is true and that the transmitted text 
has not been altered. Such function is also called 
digital signature, for which there have already pro- 
posed various systems, such as RSA code, R code, 
W code, Ml code, MH code, GS code, CR code, M 
code, E code, T code, S code, L code, GMY code, 
GMR code, OSS code and OS code, (for details, 
see Ikeno, Oyama, "Modern Cypher Theory", Elec- 
tronic Information Communication Association, 
1986, Chapters 5 to 8.) 

The foregoing embodiments, setting the frame of 
the MPEG data according to the traffic of the transmis- 
sion path and calculating the charge for the image ac- 
cording to the content of thus set frame, can realize an 
accounting system exploiting the kind and quality of the 
information and the service, thereby being adaptable to 
various information and services. 

Also according to another feature, the accounting 
process can be executed with a charge system in con- 
sideration of the amount of image information, in addi- 
tion to the content of the transmitted frame. 

Also according to still another feature, the account- 
ing can be executed corresponding to the hierarchic en- 
coding technology. 

As can be seen in Figure 2 the present invention 
can be implemented on a standard computer with an 
interface for transmission of images. The method of the 
present invention can thus be implemented by software 
controlling the computer. The computer code compris- 
ing the software is provided in a storage device which 
can comprise any conventional digital storage medium 
e.g. a magnetic disc, optical disc or programmable read- 
only memory. 
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a) a receiving terminal provided with frame set- 
ting means for setting frames for the MPEG da- 
ta to be transmitted, according to the traffic in 
said transmission path; and 

b) a transmitting terminal provided with ac- 
counting process means for effecting an ac- 
counting process with a predetermined charge 
system, and image charge information storage 
means for storing charge information for the im- 
age, to be used in said accounting process. 

3. An image transmission system for transmitting 
MPEG data through a transmission path, compris- 
ing: 

n a) frame setting means for setting frames for 
the MPEG data to be transmitted, according to 
the traffic in said transmission path; and 
b) accounting process means for effecting an 
accounting process with a charge system ac- 
cording to the frames and the amount of infor- 
mation of said transmitted MPEG data. 



4. An image transmission system for transmitting 
25 MPEG data through a transmission path, compris- 
ing: 

a) traffic check means for checking the traffic in 
said transmission path; 

b) frame setting means for setting frames for 
the MPEG data to be transmitted, according to 
the traffic in said transmission path; 

c) accounting process means for effecting an 
accounting process with a predetermined 
charge system; 

d) information amount measuring means for 
measuring the amount of information of the im- 
age transmitted through said transmission 
path; and 

e) image charge information storage means for 
storing the charge information for the image, to 
be used in said accounting process. 
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1. An image transmission system for transmitting 
MPEG data through a transmission path, compris- 
ing: 

a) means for setting frames for the MPEG data 
to be transmitted, according to the traffic in said 
transmission path; and 50 

b) accounting means for effecting an account- 
ing process with a charge system according to 
thus set frames. 

2. An image transmission system for transmitting 55 
MPEG data through a transmission path, between 

a transmitting terminal and a receiving terminal, 
comprising: 



An image transmission system for transmitting 
MPEG data through a transmission path, compris- 
ing: 

a) traffic check means for checking the traffic in 
said transmission path; 

b) frame setting means for setting frames for 
the MPEG data to be transmitted, according to 
the traffic in said transmission path; 

c) accounting process means for effecting an 
accounting process with a charge system ac- 
cording to the frames and the amount of infor- 
mation of said transmitted MPEG data; and 

d) image charge information storage means for 
storing the charge information for the image, to 
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be used in said accounting process. 

6. An image transmission system according to any of 
claims 1 to 5, further comprising charge payment 
means for paying the charge at a predetermined in- > 
terval. 

7. An image transmission system according to any of 
claims 1 to 6, wherein said accounting process 
means is provided in the transmitting side. 

8. An image transmission system according to any of 
claims 1 to 6, wherein said accounting process 
means is provided in the receiving side. 

9. An image transmission system according to any of 
claims 1 to 6, wherein said accounting process 
means is provided both in the transmitting side and 
in the receiving side. 

10. An image transmission system comprising: 

a) image destination designating means for re- 
questing the image transmission to an image 
provider, by designating an arbitrary image re- 
ceiving device as the destination of the image; 

b) image transmission means for transmitting 
an image to the image receiving device desig- 
nated by said image destination designating 
means; and 

c) accounting process means for effecting 
charge accounting to the designated destina- 
tion of the image or the user who has received 
said image. 

11. An image transmission system according to any of 
claims 7 to 1 0, further comprising cypher means for 
effecting at least encyphering or digital signature on 
said transmitted information. 

12. An image transmission system for handling MPEG 
data, comprising: 

a) accounting means for effecting an account- 
ing process according to the kind of frames 
transmitted among said MPEG data; and 

b) charge storage means for storing the charge 
for the image. 

13. An image transmission system for handling MPEG 
data, comprising: 

a) detecting means for detecting the kind of 
frames transmitted among said MPEG data; 
and 

b) accounting means for effecting an account- 
ing process according to said kind. 



14. An image transmission system for handling MPEG 
data, comprising: 

a) means for detecting the kind and the amount 
of information of frames transmitted among 
said MPEG data; and 

b) accounting means for effecting an account- 
ing process according to said kind and the 
amount of information. 

15. An image transmission system for handling MPEG 
data, comprising: 

a) accounting means for effecting an account- 
ing process according to the kind of frames 
transmitted among said MPEG data; 

b) information amount measuring means for 
measuring the amount of information of said 
transmitted frames; and 

20 c) charge storage means for storing the charge 

for the image. 

16. An image transmission system for handling MPEG 
data, comprising: 

25 

a) accounting means for effecting an account- 
ing process according to the kind and the 
amount of information of the frames transmitted 
among said MPEG data; and 
30 b) charge storage means for storing the charge 

for the image. 

17. An image transmission system for handling MPEG 
data, comprising: 

35 

a) accounting means for effecting an account- 
ing process according to the kind and the 
amount of information of the frames transmitted 
among said MPEG data; 
40 b) information amount measuring means for 

measuring the amount of information of said 
transmitted frames; and 
c) charge storage means for storing the charge 
for the image. 

45 

18. An image transmission system according to any of 
claims 1 3 to 1 7, further comprising charge payment 
means for paying the charge at a predetermined in- 
terval. 

50 

19. An image transmission system according to any of 
claims 13 to 18, wherein said accounting means is 
provided in the transmitting side. 

55 20. An image transmission system according to any of 
claims 1 3 to 18, wherein said accounting means is 
provided in the receiving side. 
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21. An image transmission system according to any of 
claims 13 to 18, wherein said accounting means is 
provided both in the transmitting side and in the re- 
ceiving side. 

22. An image transmission system according to any of 
claims 19 to 21, wherein all the frames of said 
MPEG data are transmitted, and said accounting 
means is adapted to effect an accounting process 
according to the kind of frames decoded among 
said MPEG data. 

23. An image transmission system according to any of 
claims 19 to 22, further comprising cypher means 
for effecting at least encyphering or digital signature 
on said transmitted information. 

24. An image transmission method for transmitting 
MPEG data through a transmission path, the meth- 
od comprising the steps of setting frames for the 
MPEG data to be transmitted according to the traffic 
in the transmission path, and effecting an account- 
ing process with a charge system according to the 
thus set frames. 

25. An image transmission method for transmitting 
MPEG data through a transmission path between a 
transmitting terminal and a receiving terminal, the 
method comprising the steps of: 

setting frames for the MPEG data to be trans- 
mitted, according to the traffic in the transmis- 
sion path; and 

effecting an accounting process with a prede- 
termined charge system based on stored 
charge information for the image to be used 
with the accounting process. 

26. An image transmission method for transmitting 
MPEG data through a transmission path, the meth- 
od comprising the steps of: 

setting frames for the MPEG data to be trans- 
mitted according to the traffic in the transmis- 
sion path; and 

effecting an accounting process with a charged 
system according to the frames and the amount 
of information of the transmitted MPEG data. 

27. An image transmission method for transmitting 
MPEG data through a transmission path, the meth- 
od comprising the steps of: 

checking the traffic in the transmission path; 
setting frames for the MPEG data to be trans- 
mitted according to the traffic in the transmis- 
sion path; 

effecting an accounting process with a prede- 



termined charge system, measuring the 
amount of information of the image transmitted 
through the transmission path; and 
storing the charge information for the image to 
5 be used in the accounting process. 

28. An image transmission method for transmitting 
MPEG data through a transmission path, the meth- 
od comprising the steps of: 

10 

checking the traffic in the transmission path; 
setting frames for the MPEG data to be trans- 
mitted according to the traffic in the transmis- 
sion path; 

is effecting an accounting process with a charge 

system according to the frames and the amount 
of information of the transmitted MPEG data; 
and 

storing the charge information for the image to 
20 be used in the accounting process. 

29. A image transmission method comprising the steps 
of: 

25 requesting the image transmission to an image 

provider by designating an arbitrary image re- 
ceiving device as the destination of the image; 
transmitting an image to the image receiving 
device designated during the image destination 

30 designation step; and 

effecting charge accounting to the designated 
destination of the image or the user who has 
received the image. 

35 30. An image transmission method for handling MPEG 
data comprising the steps of: 

effecting an accounting process according to 
the kind of frames transmitted among the 
40 MPEG data; and 

storing the charge for the image. 

31. An image transmission method for handling MPEG 
data comprising the steps of: 

45 

detecting the kind of frames transmitted among 
the MPEG data; and 

effecting an accounting process according to 
the kind of frames transmitted. 

50 

32. An image transmission method for handling MPEG 
data comprising the steps of: 

detecting the kind and the amount of informa- 
55 tion of frames transmitted among the MPEG 

data; and 

effecting an accounting process according to 
the kind of frames transmitted and the amount 
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of information of frames transmitted. 

33. An image transmission method for handling MPEG 
data comprising the steps of : 

5 

effecting an accounting process according to 
the kind of frames transmitted among the 
MPEG data; 

measuring the amount of information of the 
transmitted frames; and 10 
storing the charge of the image. 

34. An image transmission method for handling MPEG 
data comprising the steps of: 

75 

effecting an accounting process according to 
the kind and the amount of information of the 
frames transmitted among the MPEG data; and 
storing the charge for the image. 

20 

35. An image transmission method for handling MPEG 
data comprising the steps of: 

effecting an accounting process according to 
the kind and the amount of information of the 25 
frames transmitted among the MPEG data; 
measuring the amount of information of the 
transmitted frames; and 
storing the charge for the image. 

30 

36. A storage device for storing instructions for carrying 
out the method of any one of claims 24 to 35. 

37. A storage device according to claim 36 comprising 

a digital storage medium containing computer code 35 
comprising instructions for controlling a computer 
to carry out the method of any one of claims 24 to 
35. 

40 
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FIG. 4 
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FIG. 5 
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FIG. 7 
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FIG. 8 



BUS 
805 



CPU 



.801 



\7 



.802 



I/O 



4 ► 



STORAGE 
DEVICE 



JL 
806 



800 



RAM 



803 



ROM 



804 



JL 



.807 



MEASUREMENT 
EQUIPMENT 
1 



IMAGE TRANSMISSION SYSTEM 



FIG. 10 



£L 



1002 



ACCOUNTING 


UNIT 









TRANSMISSION 

TERMINAL 

DEVICE 



1001 



TRANSMISSION 
LINE 



RECEPTION 

TERMINAL 

DEVICE 



1003 



26 



EP0 756 424 A2 



FIG. 9A 
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